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@ Method and apparatus for improving the alignment of radiographic images. 

@ In a diagnostic process in which two images are made on 
an image recording medium of the same structure at the 
beginning and the end of a time Interval during which the 
structure changes, a method is provided for permitting a 
computing device to improve the alignment of the images as 
reproduced in the form of pixels on a monitor screen. A 
particular spatial pattern of marker elements is provided, when 
each of the images is made, in a particular juxtaposition to the 
structure being imaged, so that the shadows of the elements 
arise on the respective images. The computing device can then 
rotate, translate and alter the scale of one image with respect to 
the other until the shadows of the elements on one Image 
coincide as closely as possible with those on the other image. 
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Description 



METHOD AND APPARATUS FOR IMPROVING THE ALIGNMENT OF RADIOGRAPHIC IMAGES 



This invention relates generally to the field of 
radiology, and has to do particularly with a method 
and apparatus for Improving the alignment of 5 
radiographic images taken at different times of the 
same tissue structure, so that the images can be 
sequentially shown in aligned condition, whereby 
changes in the structure can be noted. 

The present invention will be described specifi- 10 
cally in connection with dental radiology and its use 
in determining on-going structural changes in teeth 
and related structures (such as remineralization). 
However, it will be understood from what follows that 
the principles of this invention could be applied in 15 
other areas. 

It is known to utilize a computer to carry out 
densitometry analyses of standardized radiographs 
taken of the same tissue structure at different points 
in time, in order to detect tissue change. For 20 
example, in the dental area It is known to compare 
radiographs of the same tooth structure taken at 
different times, in order to detect remineralization in 
the teeth or lesions in the periodontal tissue. One 
technique utilized in this procedure is called sub- 25 
traction radiography, wherein a computer will digitize 
two standardized radiographs of the same structure 
taken at different times, and then subtract the one 
from the other. If the two radiographs are identical, 
the result will be a uniform picture with no apparent 30 
detail. However, if the radiographs differ, for example 
at anatomical locations which have changed bet- 
ween the exposures, then the subtraction image will 
exhibit a different density (grey level) than the 
background. The above principles are well under- 35 
stood, and form part of the prior art. Reference may 
be made to an article entitled "Subtraction Radio- 
graphy and Computer Assisted Densitometry Ana- 
lyses of Standardized Radiographs", by Oilman et 
al, published in the Journal of Periodontal Research, 40 
1985: 20:644-651. 

Thus, it wiil be understood that, when wishing to 
compare radiographic images taken at different 
times of the same dental structure for the purpose of 
following changes in the structure, the ideal situation 45 
is that in which both or all of the images are made 
under precisely the same conditions of exposure. In 
other words, for every image, the relative positions 
of the film, the teeth and the source of X-rays would 
be identical. Moreover, the degree of exposure, the 50 
film characteristics, and the intensity of the X-ray 
source would also have to be the same from 
exposure to exposure. If this could be achieved 
consistently, then subtraction radiography could be 
carried out directly and the information thus gener- 55 
ated would be highly reliable. 

However, as a practical matter the perfection of 
alignment is generally not attained. Although a bite 
block of conventional nature can be utilized to 
ensure to a large degree that the position of the film 60 
with respect to the teeth is consistent from image to 
image, it will be appreciated that even a slight 
change in the geometric position of the source of the 



X-rays from image to image (further or closer, up or 
down, right or left) will significantly alter the scale or 
position of the image by an amount sufficient to 
interfere with analysis of structural changes by the 
technique of subtraction radiography. Furthermore, 
where the film is improperly inserted into the bite 
block, sequential images can be mutually rotated 
even where the source of the X-ray is precisely the 
same. 

Conventionally, attempts have been made to 
overcome the alignment problem by utilizing exter- 
nal beam-image receptor alignment devices that are 
very cumbersome and problematic to use. Ref- 
erence may be had to an article by McHenry et al, 
entitled "Methodological Aspects and Quantitative 
Adjuncts to Computerized Subtraction Radio- 
graphy", published in the Journal of Periodontal 
Research 1987; 22: 125-132. Even with such de- 
vices, however, problems can persist In attaining 
perfect alignment. For example, problems arising 
through improper film insertion into a bite block are 
not overcome by the external alignment devices. 
And of course, such devices do not address the 
problem of attaining gray-scale uniformity. 

In view of the difficulties and problems outlined 
above, it is an object of one aspect of this invention 
to make use of modern microprocessor capabilities 
to improve the alignment of radiographic images. 
More specifically, this invention involves the provi- 
sion of a plurality of marker elements in a specific, 
repeatable spatial juxtaposition with respect to the 
animal tissues being investigated (for example the 
teeth), such that the radiographic images contain 
the shadows of the marker elements. The radio- 
graphic images thus produced are converted to 
arrays of pixels and stored electronically. Each pixel 
has a pair of geometric coordinates and also an 
index number identifying its grey level. The micro- 
processor or computing device then operates on 
one of the pixel arrays by first identifying the 
shadows of the marker elements, and then bringing 
the geometric coordinates of the marker element 
shadows on one array into substantially overlying 
relationship with the geometric coordinates of the 
marker element shadows on the other array, using 
translation, rotation, scaling up, scaling down, 
differential scaling, or a combination of these spatial 
transformations. By incorporating an aluminum step 
wedge in association with the marker elements, 
such that the image of the step wedge also appears 
on the radiograph, the computer can internally 
adjust the gray-scale of the various pixels in order to 
balance the shading in the different radiographs. 
This is carried out in two separate processes. First, 
the complete images are corrected for differences in 
contrast using either a pseudosigmoidai function or 
other parametric functions or non-parametric ap- 
proaches. Then, the images of the steps of the 
wedge are used to construct a calibration curve to 
convert levels of radiographic density into equivalent 
weights of hydroxyapatite mineral of bone. In this 
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way, changes in radiographic density can be con- 
verted into equivalent changes in bone density. Any 
structural changes can then be determined by 
subtraction radiography carried out by the com- 
puter. 

Even more particularly, this invention provides a 
method for investigating changes in animal tissues, 
comprising: 

at a first point In time, providing a plurality of marker 
elements in a specific, repeatable spatial juxtaposi- 
tion with respect to the tissues, and making a first 
image of the tissues by exposing a first recording 
medium to radiation that has first passed through 
both the tissues and the marker elements, whereby 
the shadows of the marker elements appear super- 
imposed on the first image of the tissues, 
at a later point in time, providing the same plurality of 
marker elements in substantially the same specific, 
repeatable spatial juxtaposition with respect to the 
tissues, and making a second image of the tissues 
by exposing a second recording medium to radiation 
that has first passed through both the tissues and 
the marker elements, whereby the shadows of the 
marker elements appear superimposed on the 
second image of the tissues, 
converting the first and second images to first and 
second arrays of pixels and storing the pixel arrays 
electronically in a memory means, wherein each 
pixel has a pair of geometric coordinates and also an 
index number identifiying its grey level, 
using a computing device to improve the alignment 
of one array of pixels with respect to the other, 
wherein the computing device identifies the sha- 
dows of the marker elements in the two pixel arrays, 
and operates on one array in such a way as to bring 
the geometric coordinates of the shadows on one 
array into the closest possible coincidence with the 
geometric coordinates of the shadows on the other 
array, by causing said one array to undergo one or 
more of the operations of: 

a) translation, 

b) rotation, 

c) scaling up, 

d) scaling down, 

e) differential scaling, storing the improved 
pixel array electronically in the memory means, 
and assessing the intensity difference between pairs 
of corresponding pixels In the Improved array and 
the said other array to determine whether tissue 
change is indicated. 

Further, this invention provides, for a diagnostic 
process in which two images are made on an image 
recording medium of the same structure at the 
beginning and the end of a time interval during which 
the structure changes, a method of permitting a 
computing device which electronically stores the 
images to improve the alignment of the images as 
reproduced in the form of pixels on a monitor 
screen, each pixel having a specific grey level, the 
method comprising providing, when each of the 
images is made, a particular spatial pattern of marker 
elements in a particular juxtaposition to said struc- 
ture so that the shadows of the elements arise on 
the respective images, whereby the computing 
device is enabled to rotate, translate and alter the 



scale of one image with respect to the other until the 
shadows of the elements on one image coincide as 
closely as possible with those on the other image. 
Finally, this invention provides, for a diagnostic 
5 process in which two radiographic images are made 
on radiographic film of the same human tissues 
within or close to the teeth at the beginning and the 
end of a time interval during which tissue change 
occurs, a bite block for permitting a computing 
10 device which electronically stores the images to 
improve the alignment of the images as reproduced 
' in the form of pixels on a monitor screen, each pixel 
having a specific grey level, the bite block registering 
repeatably with the same teeth of a given person and 
15 incorporating a specific spatial pattern of marker 
elements whereby when the bite block is held 
between the given person's teeth the elements will 
have a specific and repeatable juxtaposition with 
respect to the dental structure and the shadows of 
20 the elements will arise on the respective radio- 
graphic films, thereby enabling the computing 
device to rotate, translate and alter the scale of one 
image with respect to the other until the shadows of 
the elements on one image coincide as closely as^ 
25 possible with those on the other image. 

One embodiment of this invention will be de- 
scribed with reference to accompanying drawings, 
in which like numerals denote like parts throughout 
the several views, and in which: 
30 Figure 1 shows a side view and top view of 

digitizing apparatus for use with the method of 
this invention; 

Figure 2 is a perspective view of a bite block 
for use with this invention; 
35 Figure 3 is a cross-sectional view through the 

bite block shown in Figure 2, also illustrating the 
position of teeth with respect to the bite block; 

Figure 4 is an exploded view showing the 
X-ray source, several teeth, the bite block of 
40 Figure 2 (Inverted) and a piece of X-ray film ; 

Figure 5 is a face view of an exposed 
processed film in accordance with this inven- 
tion; 

Figures 5(a), (b) and (c) represent, respec- 
45 tively, a pre-lesion X-ray image, a post-lesion 

X-ray image, and a subtraction image made 
after spatial and intensity alignment; and 

Figures 6 through 10 contain logic flow- 
charts giving an overview of the program steps 
50 carried out in connection witfvthis invention. 

As has been explained above, the aim of this 
invention is to provide a means of recording markers 
on diagnostic images so that images obtained on 
successive occasions may be analyzed and oper- 
55 ated on by a computer or microprocessor in order to 
provide accurate alignment, of the separate images 
through calculations performed by the computer. In 
addition to the alignment function, however, the 
computer can also be utilized to enhance the 
60 images, and to carry out a diagnostic analysis of the 
image in order to provide evidence of and quantifica- 
tion of changes or differences between the suc- 
cessive images. 
Essentially, the markers are placed on the diag- 
65 nostic images by interposing a plurality of marker 



3 



5 EP 0 314 506 A1 6 



elements in the beam of a diagnostic imaging 
system, in such a way that the shadows of the 
markers are recorded on the image of the anatomi- 
cal structures that are of diagnostic interest. These 
marker images or shadows provide a permanent 
record, in the image, of the positional relationship 
between (I) the source of the diagnostic radiation for 
the imaging system, (2) the anatomical stmctures of 
interest, (3) the markers themselves, and (4) the 
recording medium for the diagnostic image. 

It is important to understand that the source of the 
diagnostic radiation for the imaging system can take 
a number of forms not restricted to diagnostic dental 
X-rays. Any imaging system will be able to carry out 
the principle of this invention so long as an image of 
the markers is formed by the system. 

While dental X-ray film is described below in 
connection with the specific embodiment disclosed 
in the drawings, it is well known to form images 
xerographically or even directly in the electronic 
components of a camera system which is sensitive 
to diagnostic radiation without the intermediate step 
of forming an image on X-ray film. 

It is further to be understood that the use of 
markers is of general application in the head and 
neck region, and is not restricted to intra-oral use. 
Indeed, the basic principle of this invention (as set 
out in claim 1, for example) is not even restricted to 
human or animal tissues. The principle can be 
applied in any structure which evidences change 
over a time interval and of which images can be 
made by passing radiation through it or reflecting 
radiation off it (e.g., the markers could be white dots 
on an engine part, imaged conventionally), in the 
case of the human being, the teeth can be used as 
fixed reference points for extra-oral as well as 
intra-oral diagnostic imaging. Other fixed points of 
the skeleton of the head, such as the oral meatl and 
the bridge of the nose, can also be used as 
reference points. 

Turning first to Figures 2, 3 and 4, a bite block 10 
constructed in accordance with this invention in- 
cludes a clamp portion 12 which is connected to a 
wall 14 extending substantially perpendicularly 
therefrom. Embedded in the end of the clamp 
portion 12 which is connected to the wall 14 are the 
two ends 15 of a film clip 16. The film clip 16 includes 
a substantially rectangular loop of wire having two 
portions 17 which are offset toward the wall 14, in 
order to grip a film holder. In Figure 3, the film itself is 
shown at 17a, but of course it will be understood that 
the film must be protected from exposure to light up 
to the point of its development. For this purpose, a 
standard plastic envelope would typically be pro- 
vided, of a kind well known in the art. Thus, the offset 
portion 17 of the film clip 16 would press the film 
envelope against the back of the wall 14, thus 
holding the film 17a itself in close juxtaposition with 
the back of the wall 14. 

The clamp portion 12 has a further layer 18 
superimposed thereon, the purpose of the layer 18 
being to contain a plurality of reference balls 19, and 
a step wedge 20. The step wedge is a block of 
aluminum cut into discrete steps which present a 
radiographic "face" of 1, 2, 3, 4...8 mm thickness, 



forming (roughly) equal-shaped and equal-sized 
squares on the image. Additional reference balls 22 
are embedded in the wall 14, the pattern being well 
seen in Figures 2 and 4. 
5 Also shown in Figures 2 through 4 is a quantity of 
bite impression material 24 which is of conventional 
nature and well known in the art. This material is 
placed on the layer 18 in a somewhat plastic 
condition, whereupon the patient bites the bite 

10 block, holding the teeth in contact with the material 
24 until the latter has set This leaves an impression 
of the specific teeth in the material 24, which permits 
the bite block to be precisely relocated in clamped 
position between the patient's teeth for a series of 

15 subsequent X-rays. Trius It will be appreciated that 
the bite block shown in Figures 2-4 allows for the 
reference bails 19 and 22 to have a specific and 
repeatable juxtaposition with respect to the same 
dental structure (teeth and periodontal tissues), and 

20 the shadows of the balls 19 and 22 will appear on 
each radiographic film 17a. The balls 19 and 22 are 
preferably of lead, although any material could be 
used, so long as it left a clearly discernable shadow 
on the radiographic film. 

25 It will thus be appreciated that, by preparing two 
radiographic images on suitable film or other 
medium at the beginning and the end of a time 
interval during which the tooth structure changes 
(for example by remineralization, lesion or decay), it 

30 will be possible firstly to convert each image to an 
array of pixels each having a specific geometric 
position and a specific grey level, whereby a 
computer or microprocessor will be enabled to 
rotate, translate and/or alter the scale of one image 

35 with respect to the other until the shadows of the 
marker elements on one image substantially coin- 
cide with those on the other image. 

Digitizing 

40 To carry out the analog-to-digital conversion of 
each X-ray image, an apparatus was constructed for 
mounting the three principle components used in 
this process: 1. a standard (Kodak) carousel slide 
projector fitted with a macro-focus lens; 2. a sheet of 

45 neutral-density acetate stretched on a frame, with 
guide runners; and 3. an Electrohome black-and- 
white video camera connected to the controlling 
minicomputer. Seen in Figure 1, the apparatus is 
designed as an optical "bench" of sorts, with a 

50 projector 30 and camera 32 being fixed in position at 
opposite ends of the apparatus, and a display screen 
34 movable along the projector-camera axis. 

Each X-ray is mounted in a glass photographic 
slide and displayed as a 20 cm -wide by 15 cm tall 

55 image back-projected on the acetate screen 34 
positioned approximately 40 cm in front of the slide 
projector 30. In this way, the displayed size and 
focus of each projected image may be controlled by 
any manipulation of the lens controls of the projector 

60 or camera, and the positioning of the projection 
screen between the two devices. 

Each image is digitized as a 512-row and 512-coI- 
umn matrix of values with a range of 0 to 255. At this 
resolution, it appears that the limiting step in the 

65 imaging process is the actual exposure of the 
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radiographic film and the photographer's abilities 
and method. Two sources of variation appear to 
account for the majority of difficulties encountered 
with current clinical methods, each of which arises 
from the susceptibility of film radiography to errors 
produced by human users in a situation that does 
not lend itself readily to any form of controlled 
automation (technologically and socially). Variations 
in patient, film and camera positioning from expo- 
sure to exposure, and the requirements for such 
accurate positioning posed by the process of 
imaging a small area with a large device from a 
distance ensure that comparison of images taken at 
separate times (over years), by separate radiogra- 
phers will be very difficult. Secondly, small (random) 
variations in the X-ray beam voltage on exposure, 
film quality and post-exposure processing induce 
variations in both the overall intensity and the relative 
distribution of the 256 possible levels of intensity 
that can further obscure small changes in tissue 
between exposures. 

Image Processing 

Three software processes have been developed 
for use with pairs of images, in order to: 1. correct 
spatial transformations of the tissues imaged radio- 
graphically as would be evident if the two images 
were superimposed (spatial alignment), 2. correct 
brightness and contrast differences due to the 
above spatial transformations and fluctuations in the 
radiographic beam intensity, film and processing 
quality (intensity alignment), and 3. compare two 
images which have been equalized by the above two 
processes so as to detect differences between 
them. The software interface involves the use of a 
video terminal and keyboard, and a monochrome 
graphics display and "mouse" pointer. Each process 
is described below, along with its associated 
hardward and software. 

Spatial Alignment 

Hardware 

Spatial alignment involves matching of reference 
points on corresponding areas of each image so that 
tissue structures that remain constant (evident) on 
two images may superimpose exactly, or with as 
little error as possible. Radiographic images provide 
poor reference markers, as they present indistinct 
structural features and boundaries, which are unre- 
liable and sensitive to camera positioning error. The 
alignment process described earlier introduces 
non-tissue markers that provide sharp, constant 
reference points with a marker-tissue spatial rela- 
tionship that can be controlled. 

As described earlier, the reference markers 
preferably consist of lead balls that have been 
embedded in two perpendicular planes of a bite 
block modified from those currently used to hold the 
radiographic film during exposure. Lead is used for 
maximum density, and balls are used for transforma- 
tion invariance. (see Figures 2 and 3). The X-ray 
"shadow" produced by the balls is in effect superim- 
posed on that produced by the imaged tissues, as 
seen in Figure 5, and thus can serve as artificial 



reference points that can be used for all exposures 
of the tissues of interest providing that the relation- 
ship between the reference markers and the 
underlying tissue is maintained for ail exposures 

5 (i.e., the bite block must be seated on the same 
teeth in the same position). 

In practice, a patient would be fitted with a bite 
block (or several) at the time of first consultation 
which would be used for all exposures of the tissues 

10 of interest (for which they were first employed). As 
described, the soft impression of the biting surface 
of the teeth to be imaged permits accurate position- 
ing on the teeth, to maintain a constant marker- 
tissue relationship. The spatial arrangement of the 

15 reference points allows the best empirical alignment 
possible with the software algorithm used, appear- 
ing as white disks forming two concentric rectangles 
surrounding the region of interest (see Figure 4). We 
currently use a ball diameter of 1/32 inch. 

20 

Software 

Once the reference and comparison images are 
digitized, the alignment process consists of three 
stages: 1. selection of reference points, 2. alignment 

25 of reference points on one image to the correspond- 
ing points on the other and, by this, all other image 
points, and 3. repair of image "fractures" caused by 
the transformations required to accomplish the 
alignment. Three separate software programs per- 

30 form the separate stages, although they could be 
combined into one larger program. 

Because the balls present a well-known radio- 
graphic appearance, they can be selected with ease 
by an operator equipped with a mouse pointer that 

35 controls a cursor on the monochrome display 
screen. The operator indicates (with a crosshair 
cursor) the centre of each reference marker to\be 
used, and the coordinates of the selected point are 
stored, The sequence of markers selected must 

40 remain the same for both images, although there is 
no empirical effect of overall selection order. 

Once reference markers have been chosen, and 
their spatial coordinates known, the process of 
alignment is started with the determination of the 

45 coordinate differences between each corresponding 
pair of points. Each difference (along X and Y) is 
squared and summed and presented to a curve-fit- 
ting algorithm that tries to minimize this difference 
by iterative modifications (transformations) applied 

50 to the to-be-matched (TBM) image's reference 
marker coordinates. The transformations used in- 
volve application of (fixed and predetermined) 
sequences of trigonometric functions to the TBM 
coordinate values, so as to produce translations 

55 along the X- and/or Y-axes, rotations around X-, Y- 
or Z-axes, and dilation or contraction of the X- 
and/or Y-axes (see Table 1). The algorithm applies 
differing amounts of each transformation in turn, and 
terminates when the lowest possible global image 

60 difference is determined (as measured by the sum of 
squared differences between reference-image mar- 
ker and TBM-image marker centre coordinates). The 
parameters used for this "optimal" sequence of 
transformations are stored and applied to every 

65 point on the TBM image. In essence, the program 
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determines the best way to shift, rotate, expand or 
contract the TBM image, so that its markers best 
superimpose on those of the "standard" image and 
then apply these operations to every other point on 
the TBM image. 

Table 1 : Alignment models tested Each model is 
composed of two or three successive transforma- 
tions: 

Model 1: 

(1) Translation along X- and Y-axes 

(2) Rotation around Z-, Y-, and X-axes 

Mode! 2: 

(1) Translation along X- and Y-axes 

(2) Rotation around Z- and Y-axes 

(3) Dilation (size change) of X- and Y-axes 

Mode! 3: 

(1) Perspective transformation with manipu- 
lation of 

-viewing projection, and 
- projection plane 

(2) Rotation around Z-, Y-, and X-axes 

Model 4: 

(1) Translation along X- and Y-axes 

(2) Dilation (size change) of X- and Y-axes 

(3) Rotation around Z-axis 

Because of limits on computational precision and 
image resolution, and differences in camera distanc- 
ing from the tissues, the transformed image may 
contain regions for which no discrete transformed 
point can be calculated. For example, a TBM image 
that is smaller than the reference (or initial) image 
will require fractional expansion for proper align- 
ment, and the floating-point coordinates used to 
represent each new image coordinate pair are 
rounded up or down to the nearest integer for 
display. This error would appear as a pattern of 
no-intensity horizontal, vertical and/or diagonal lines 
(solid or broken) of one unit width superimposed on 
the transformed image. For ail transformations 
performed to-date (and those expected), these lines 
can be easily removed by writing to each no-intensity 
point the average of its (up to eight) nearest 
non-zero neighbors. 

Once the spatially-transformed image has been 
computed, it can be stored in place of the TBM 
image, as it will represent the best spatial fit of that 
image to the reference image. The pair of images to 
be compared can then be further manipulated for 
purposes of enhancement (perhaps to increase 
contrast or definition), or in some cases may be 
amenable to immediate comparison. It has been 
found, however, that an additional source of image 
differences, unrelated to pathological differences 
and resulting from inadequacies in the technology 
and practice of film-screen radiography, often 
necessitate an additional stage of image equalization 
before proper comparison and measurement may be 



performed. 
Intensity Alignment 

5 Software 

After spatial alignment, and before comparison, 
images must be equalized for variations in exposure 
duration, film response, and processing controls. 
One program controls this alignment stage with little 

10 operator intervention. The frequency distribution of 
intensity levels of each image is calculated and 
converted into a relative frequency distribution. 
These distributions in turn can then be converted 
into probability density functions for each image by 

15 calculating a cumulative frequency distribution. The 
probability density function determined for each 
image can then be transformed to fit an"ideal° 
(specified) distribution, and the image's new fre- 
quency distribution can be reconstituted. Currently, 

20 the ideal distribution is a pseudo-sigmoidal function 
with those image points in the top or bottom 50/o of 
the frequency distribution set to their respective 
extremes, and the intermediate 900/o of the distribu- 
tion fit to a linear function with a slope of 1 (see 

25 Figure 5). An alternate distribution currently being 
tested is the gamma probability density function, 
which, when its parameters are set appropriately, 
assumes a shape much like that found empirically 
with X-ray images (i.e., a positively-skewed quasi- 

30 normal distribution of positive values), and thus can 
effect an initial, equalizing, fit with fewer and smaller 
intensity-value transformations than distributions 
with other forms. 
Once this final phase of image equalization has 

35 been accomplished, the two images can be com- 
pared with a minimum of non-pathological image 
difference. Other operations can also be enacted on 
the images prior to comparison. Further intensity 
distribution manipulations may be used to highlight 

40 selected corresponding regions on each image 
(e.g., fitting to normal, exponential or sigmoidal 
curves). Image "definition" may be enhanced to 
show detail, or reduced to remove "grain". 

45 Image Comparison 

Subtraction of one image from another is the most 
straightforward process by which images can cur- 
rently be compared. An informal method, involving 
rapid display of each of a pair of images in 

50 succession, can be used for an initial and easily-rec- 
ognized visual identification of obvious differences. 
For quantifiable differences, however, more sophis- 
ticated methods must be employed, and this 
display-oriented method will not be discussed 

55 further. 

One central subtraction method is currently used 
to perform all comparisons (on pairs of images), 
although several analytic software routines are 
available to provide parameters controlling the 

60 subtraction operation. As was done for the spatial 
alignment transformations, a "reference" image is 
selected; for comparison, the oldest of a pair of 
exposures would usually be considered for this role. 
The intensity of each comparison-image point is 

65 subtracted from the intensity of its corresponding 
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point in the reference image. 

The subtraction produces at each point one of 
three classes of values: positive, negative and zero 
indicating, respectively, tissue gain, tissue loss, and 
no tissue change (see Figure 6). The resulting 
"difference" image can be displayed directly (as an 
image of absolute differences) or coded to reflect 
the result of the subtraction at each point, with 
tissue gain appearing as high intensity (white), loss 
appearing as low intensity (black) and no change 
appearing as medium intensity (grey). Because the 
image equalizations performed are still subject to 
operator error or calculation and display limits, a 
certain margin of error remains that may hinder 
measurement of true differences. For this reason the 
subtraction process can be constained by limits on 
the amount of numeric difference between sub- 
tracted points that is considered acceptable and to 
be ignored by the measurement software. 

Several methods can be used to determine those 
intensity changes that are considered to be non-sig- 
nificant and, conversely, those that exceed a 
particular threshold. The simplest, and thus first 
introduced, method will involve operations on the 
distribution of image-pair differences resulting from 
subtraction (centered on 0 and ranging from 0-255 
positively and negatively) : specifically, the use of the 
distribution's standard deviation (or 5th and 95th 
percentiles) to determine the upper and lower 
thresholds for "difference". 

Measurement of Change 

Once suitable limits on point differences have 
been established, only those pairs of image points 
that are found to differ "significantly" (gain or loss) 
will be considered for further analysis, it is expected 
that further enhancement will be required to con- 
strain the search for significant differences to 
specific image regions, and to exclude areas of 
difference smaller than those of clinical interest 
(e.g., scattered unitary points). 

Once the final regions of difference have been 
localized, their absolute difference can then be 
related to a recognized measure of tissue density. 
The step-wedge located at the top of each image 
can be used as a reference density with which all 
pathological tissue densities can be compared. 

The operator, again using the mouse pointer and 
the screen cursor as for spatial alignment, selects 
the center of each grey square presented by the 
step-wedges of the reference and TBM images. The 
average of all intensities in a N x N unit square 
centered on the point selected by the operator is 
used as the intensity value of the selected point. This 
averaging is performed to remove noise introduced 
by the film's grain, and minimize intensity variations 
remaining after ail equalizing transformations. 

Once all points have been chosen, a mean value 
for each step-wedge density is calculated from the 
values presented by each image, and these values 
are used to determine the particular function that 
characterizes the relationship between step-wedge 
density and resulting intensity level. When this 
function (and its parameters) have been determined, 
the mean difference of the area or areas that have 



been marked as significantly different is then 
translated into a specific density of aluminum. A 
standard empirical relationship can then be used to 
translate the aluminum-density value into a value of 
5 hydroxyapatite-density, a widely-used density me- 
tric. 

In Figure 5, the exposed processed film shows the 
shadows 40 of the lead reference balls, along with 
the skeletal bone 42, the individual teeth 44, and the 

10 image of the step-wedge 46. 

In Figure 5, part (a) is a pre-lesion radiograph, and 
part (b) Is a post-lesion radiograph. In the image (b), 
a first arrow 50 points to the bottom edge of the 
image, above which a demineralization location is 

15 found about one third of the way up. The arrow 52 
shows a remlnerallzatlon location, again about one 
third of the way up. 

Figure 5 (c) shows an idealized subtraction image, 
where the black portion 54 indicates loss of tissue, 

20 whereas the white portion 56 shows tissue gain. The 
remainder of the image (c) shows no change. 



25 Claims 



1. For a diagnostic process in which two 
images are made on an image recording 

30 medium of the same structure at the beginning 

and the end of a time interval during which the 
structure changes, a method of permitting a 
computing device which electronically stores 
the images to improve the alignment of the 

35 images as reproduced in the form of pixels on a 

monitor screen, each pixel having a specific 
grey level, the method comprising providing, 
when each of the images is made, a particular 
spatial pattern of marker elements in a particu- 

40 lar juxtaposition to said structure so that the 

shadows of the elements arise on the respec- 
tive images, whereby the computing device is 
enabled to rotate, translate and alter the scale 
of one image with respect to the other until the 

45 shadows of the elements on one image coin- 

cide as closely as possible with those on the 
other image. 

2. The invention claimed in claim 1, in which 
the structure is human teeth, in which the 

50 images are radiographic images made on 

photosensitive film, in which the radiation is 
X-radiation, and in which the marker elements 
are separated metallic balls incorporated in a 
bite block, the X-radiation passing in order 

55 through the teeth, the marker elements, and the 

film. 

3. The invention claimed in claim 2, in which at 
least some of the metallic balls are all substan- 
tially in the same plane aligned with the plane of 

60 the film. 

4. The invention claimed in claim 2, in which a 
portion of the metallic balls are all substantially 
in a first plane aligned with the plane of the film, 
and the remaining metallic balls are positioned 

65 in a second plane at right angles to the first 
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plane. 

5. The invention claimed in claim 2, in which 
the bite block incorporates an aluminum step 
wedge to allow the computing device to align 

the grey scales of the two images. 5 

6. For a diagnostic process in which two 
radiographic images are made on raaiographic 
film of the same human tissues within or close 
to the teeth at the beginning and the end of a 

time interval during which tissue change oc- 10 
curs, a bite block for permitting a computing 
device which electronically stores the images to 
improve the alignment of the images as repro- 
duced in the form of pixels on a monitor screen, 
each pixel having a specific grey level, the bite 75 
block registering repeatably with the same 
teeth of a given person and incorporating a 
specific spatial pattern of marker elements 
whereby when the bite block is held between 
the given person's teeth the elements will have 20 
a specific and repeatable juxtaposition with 
respect to the dental structure and the sha- 
dows of the elements will arise on the respec- 
tive radiographic films, thereby enabling the 
computing device to rotate, translate and alter 25 
the scale of one image with respect to the other 
until the shadows of the elements on one image 
coincide as closely as possible with those on 
the other image. 

7. The invention claimed in claim 6, in which 30 
said marker elements are metallic balls con- 
tained within a fixed portion of the bite block. 

8. The invention claimed in claim 6, in which 
said marker elements are lead balls of which at 
least a portion are all substantially in the same 35 
plane aligned with the plane of the film. 

9. The invention claimed in claim 6, in which 
the marker elements are metallic balls, a portion 
of the metallic balls being all substantially in a 

first plane aligned with the plane of the film, and 40 
the remaining metallic balls being positioned in 
a second plane normal to the first plane. 

10. The invention claimed in claim 6, in which 
the bite block incorporates an aluminum step 
wedge to allow the computing device to align 45 
the grey scales of the two images. 

11. A method for investigating changes in 
animal tissues, comprising: 

at a first point in time, providing a plurality of 
marker elements in a specific, repeatable 50 
spatial juxtaposition with respect to the tissues, 
and making a first image of the tissues by 
exposing a first recording medium to radiation 
that has first passed through both the tissues 
and the marker elements, whereby the shadows 55 
of the marker elements appear superimposed 
on the first image of the tissues, 
at a later point in time, providing the same 
plurality of marker elements in substantially the 
same specific, repeatable spatial juxtaposition 60 
with respect to the tissues, and making a 
second image of the tissues by exposing a 
second recording medium to radiation that has 
first passed through both the tissues and the 
marker elements, whereby the shadows of the 65 



marker elements appear superimposed on the 
second image of the tissues, 
converting the first and second images to first 
and second arrays of pixels and storing the 
pixel arrays electronically in a memory means, 
wherein each pixel has a pair of geometric 
coordinates and also an index number ident- 
ifying its grey level, 

using a computing device to improve the 
alignment of one array of pixels with respect to 
the other, wherein the computing device ident- 
ifies the shadows of the marker elements in the 
two pixel arrays, and operates on one array in 
such a way as to bring the geometric coordi- 
nates of the shadows on one array into the 
closest possible coincidence with the geome- 
tric coordinates of the shadows on the other 
array, by causing said one array to undergo one 
or more of the operations of: 

a) translation, 

b) rotation, 

c) scaling up, 

d) scaling down, 

e) differential scaling, 

storing the improved pixel array electronically in 
the memory means, 

and assessing the intensity differences bet- 
ween pairs of corresponding pixels in the 
improved array and the said other array to 
determine whether tissue change is indicated. 

12. The invention claimed In claim 11, in which 
said animal tissues are within or close to human 
teeth, in which the image is a radiographic 
image made on photosensitive film, and in 
which the radiation is X-radiation. 

13. The invention claimed in claim 12, in which 
the provision of the marker elements in a 
specific, repeatable spatial juxtaposition with 
respect to the tissues is accomplished by 
providing a bite block incorporating the marker 
elements, and arranging for the bite block to be 
gripped in a reproducible fashion at the same 
location between the same teeth prior to the 
making of each radiographic image. 

14. The invention claimed in claim 13, in which 
the marker elements are all substantially in the 
same plane aligned with the plane of the film. 

15. The invention claimed in claim 13, in which 
a majority of the metallic balls are substantially 
in the same plane aligned with the plane of the 
film, and at least one metallic bail is positioned 
out of the plane of the others. 

16. The invention claimed in claim 13, in which 
the marker elements are metallic balls. 

17. The invention claimed in claim 13, in which 
the bite block incorporates a step wedge, and 
wherein the computing device utilizes the 
images of the step wedge on the two pixel 
arrays to align the grey scales of the arrays. 
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DIGITISE IMAGES FROM SLIDE-MOUNTED RADIOGRAPHS 



FOR EACH IMAGE: 



1 . COLLECTION OF COORDINATES OF CENTRES OF 

A. REFERENCE MARKERS 

B. STEP-WEDGE FACES 



2. COLLECTION OF IMAGE PIXEL-VALUE 
HISTOGRAMS 



3. COLLECTION OF IMAGE STATISTICS 
(MEANS, VARIANCES, ETC.) 



4. LABELLING OF: 

A. REFERENCE MARKER CIRCLES 

B. STEP-WEDGE OUTLINES 



PATIENT 
IMAGE-MANAGEMENT 



T" 

I 



IMAGE 
DATA AND 
STATISTICS 



IMAGES 



SPATIAL TRANSFORMATION FOR ALIGNMENT 



FLOW-CHART 1: IMAGE DIGITISATION AND CHARACTERIZATION 



FIG.6 
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REFERENCE AND COMPARISON IMAGES AND 
MARKER CENTER-COORDINATES 



FOR ALL REFERENCE MARKERS. COMPUTE SUM 
OF SQUARED DIFFERENCES BETWEEN CENTER- 
COORDINATES OF REFERENCE-COMPARISON 
MARKER PAIRS (OVERALL MISALIGNMENT) 




YES 



ADJUST PARAMETERS OF 
GEOMETRIC MODEL IN USE 



TRANSFORM ALL COMPARISON-IMAGE 
REFERENCE-MARKER COORDINATES 
(WITH MODEL AND NEW 
PARAMETERS) 



APPLY MODEL (AND NEW-FOUND 
OPTIMAL PARAMETERS) TO 
COORDINATES OF ALL 
COMPARISON-IMAGE POINTS 






STORE NEW (ALIGNED) IMAGE AS 
ADDITIONAL IMAGE OR IN PLACE 
OF OLD COMPARISON IMAGE 







REPAIR OF TRANSFORMATION- 
INDUCED IMAGE "FRACTURES": 
FOR EACH POINT WITH A VALUE 
OF 0 REPLACE THE POINT WITH 
THE MEAN OF ITS EIGHT NEAREST 
NON-ZERO NEIGHBORS 



T 



IMAGE GREY-SCALE EQUALISATION 



FLOW CHART 2: SPATIAL TRANSFORMATION FOR ALIGNMENT 

FIG. 7 
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REFERENCE IMAGE AND (ALIGNED) COMPARISON IMAGE 



FOR EACH IMAGE: 



RETRIEVE REFERENCE - AND 
COMPARISON-IMAGE 



GREY-LEVEL DISTRIBUTION 
HISTOGRAMS FROM PATIENT 
FILE 







COMPOSE CUM 
FREQUENCY DIE 
GREY-LEVELS F( 


ULATIVE I 
5TRIBUTION OF 
DR EACH IMAGE 



APPLY LINEAR FUNCTION (SLOPE = 1. 
INTERCEPTS, MAXIMUM = 255) TO 
RELATIVE CUMULATIVE FREQUENCY 
DISTRIBUTION AND MAXIMUM 



DETERMINE MAPPINGS FOR 
OLD-NEW PIXEL-VALUE 
TRANSFORMATION FOR EACH 
IMAGE 






DETERMINE NEW 
GREY-LEVEL HISTOGRAM 







TRANSFORM EACH POINT OF 
EACH IMAGE USING 
(CORRESPONDING) OLD-NEW 
MAPPING 



SAVE NEW (LINEARIZED) 
IMAGES 



FLOW CHART 3: IMAGE GREY-SCALE EQUALISATION 

FIG.8 



SAVE NEW (LINEARIZED) IMAGE 
HISTOGRAMS 



IMAGE COMPARISON 
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ALIGNED AND EQUALISED REFERENCE 
AND COMPARISON IMAGES 



1 



DETERMINE MINIMUM ACCEPTABLE 
GREY-LEVEL DIFFERENCE 

- USER-SELECTED 

- DETERMINED FROM IMAGE 
STATISTICS 



FOR EACH COMPARISON-IMAGE POINT AND 
CORRESPONDING REFERENCE-IMAGE POINT 



SUBTRACT THE GREY-LEVEL VALUE 
OF THE COMPARISON-IMAGE POINT 
FROM THAT OF THE REFERENCE-IMAGE 
POINT 



SIGNIFICANCE 



DIFFERENCE WITHIN 
0 i MINIMUM DIFFERENCE? 



YES 



NO 



DIFFERENCES + MINIMUM DIFFERENCE? 



NO 



DIFFERENCES 0 - MINIMUM DIFFERENCE? 



I 



POINT VALUE = 128 
(NO CHANGE) 



! I 

YES 



POINT VALUE = 255 
(TISSUE GAIN) 



YES 



POINT VALUE = 0 
(TISSUE LOSS) 

L L ---_-z-_- 



AMOUNT 



POINT VALUE = 0 
(NO CHANGE) 



POINT VALUE = 

ABSOLUTE 

DIFFERENCE 



J I J 



DIFFERENCE QUANTIFICATION 



FLOW CHART 4: IMAGE COMPARISON 



FIG.9 
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IGNIFICANCE - AND AMOUNT-MAPS 
OF REFERENCE-COMPARISON 
DIFFERENCES 



USER SELECTS REGION(S) OF 
"INTERESTING" DIFFERENCE 
ON SIGNIFICANCE MAP 



AREAS OF DIFFERENCE ARE 
RANK-ORDERED ACCORDING 
TO DIRECTION AND MEAN 
AMOUNT OF DIFFERENCE 



CALCULATE MEAN GREY-LEVEL VALUES 
OF 7 X 7 SQUARES CENTERED ON 
STEP-WEDGE FACES OF (ALIGNED AND 
EQUALISED) REFERENCE - AND 
COMPARISON-IMAGES 



PLOT MEAN VALUES AGAINST 
(KNOWN) VOLUMES OF 
IMAGED ALUMINUM 



INDICATE MEAN 
REFERENCE-COMPARISON 
DIFFERENCE VALUES 



USER INTERPOLATES VOLUME 
OF ALUMINUM EQUIVALENT 
TO MEAN DIFFERENCE VALUES 
AND CONVERTS TO VOLUME OF 
HYDROXYAPATITE 



FLOW CHART 5. DIFFERENCE QUANTIFICATION 

FIG. 10 
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